Skip to content

Reduce pipe load success log noise#18106

Merged
jt2594838 merged 3 commits into
masterfrom
fix/reduce-pipe-load-log-noise
Jul 10, 2026
Merged

Reduce pipe load success log noise#18106
jt2594838 merged 3 commits into
masterfrom
fix/reduce-pipe-load-log-noise

Conversation

@Caideyipi

@Caideyipi Caideyipi commented Jul 3, 2026

Copy link
Copy Markdown
Collaborator

Description

  • Lower high-frequency successful pipe-generated load, receiver, and load-tsfile analysis logs from INFO to DEBUG.
  • Preserve INFO visibility for user-triggered load-tsfile paths where possible, and keep generic compaction/file-lifecycle logs unchanged.
  • Lazily create and close the load tsfile dispatcher executor to avoid unnecessary thread pool churn on local load paths.

Validation

  • mvn spotless:apply -pl iotdb-core/datanode,iotdb-core/node-commons
  • git diff --check

@codecov

codecov Bot commented Jul 3, 2026

Copy link
Copy Markdown

Codecov Report

❌ Patch coverage is 8.88889% with 82 lines in your changes missing coverage. Please review.
✅ Project coverage is 41.85%. Comparing base (1c20df4) to head (4828508).

Files with missing lines Patch % Lines
.../plan/scheduler/load/LoadTsFileDispatcherImpl.java 9.67% 28 Missing ⚠️
...ryengine/plan/analyze/load/LoadTsFileAnalyzer.java 0.00% 25 Missing ⚠️
.../iotdb/db/storageengine/dataregion/DataRegion.java 0.00% 15 Missing ⚠️
...ngine/plan/scheduler/load/LoadTsFileScheduler.java 8.33% 11 Missing ⚠️
...iotdb/commons/pipe/receiver/IoTDBFileReceiver.java 40.00% 3 Missing ⚠️
Additional details and impacted files
@@             Coverage Diff              @@
##             master   #18106      +/-   ##
============================================
+ Coverage     41.73%   41.85%   +0.11%     
  Complexity      318      318              
============================================
  Files          5297     5297              
  Lines        373974   374015      +41     
  Branches      48270    48277       +7     
============================================
+ Hits         156075   156534     +459     
+ Misses       217899   217481     -418     

☔ View full report in Codecov by Harness.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

@Caideyipi Caideyipi force-pushed the fix/reduce-pipe-load-log-noise branch from ea1545e to e5091cb Compare July 3, 2026 06:27
Caideyipi added 2 commits July 7, 2026 11:07
…uce-pipe-load-log-noise

# Conflicts:
#	iotdb-core/datanode/src/main/java/org/apache/iotdb/db/queryengine/plan/analyze/load/LoadTsFileAnalyzer.java
#	iotdb-core/datanode/src/main/java/org/apache/iotdb/db/queryengine/plan/scheduler/load/LoadTsFileScheduler.java
#	iotdb-core/datanode/src/main/java/org/apache/iotdb/db/storageengine/dataregion/DataRegion.java
@sonarqubecloud

sonarqubecloud Bot commented Jul 9, 2026

Copy link
Copy Markdown

@jt2594838 jt2594838 merged commit ec81de1 into master Jul 10, 2026
41 of 43 checks passed
@jt2594838 jt2594838 deleted the fix/reduce-pipe-load-log-noise branch July 10, 2026 02:18
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants